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Abstract 

The status of an actor in a social context is commonly defined in terms of two factors: the total number of 
endorsements the actor receives from other actors and the prestige of the endorsing actors. These two factors 
indicate the distinction between popularity and expert appreciation of the actor, respectively. We refer to the 
former as popularity and to the latter as prestige. These notions of popularity and prestige also apply to the 
domain of scholarly assessment. The ISI Impact Factor (ISI IF) is defined as the mean number of citations 
a journal receives over a 2 year period. By merely counting the amount of citations and disregarding the 
prestige of the citing journals, the ISI IF is a metric of popularity, not of prestige. We demonstrate how a 
weighted version of the popular PageRank algorithm can be used to obtain a metric that reflects prestige. We 
contrast the rankings of journals according to their ISI IF and their weighted PageRank, and we provide an 
analysis that reveals both significant overlaps and differences. Furthermore, we introduce the Y-factor which is 
a simple combination of both the ISI IF and the weighted PageRank, and find that the resulting journal rankings 
correspond well to a general understanding of journal status. 
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1 Introduction 

Some people are popular but not prestigious and vice versa. For example, an author of pulp detectives may 
sell many books, but may not have earned the respect of literary critics. Conversely, a Nobel Prize in Lit- 
erature winner may be highly valued among literary experts, yet never make the New York Times bestseller 
list. In essence, these examples reveal the existence of two factors that contribute to the status of an actor in a 
social context: the total number of endorsements the actor receives from other actors, and the prestige of the 
endorsing actors. In the remainder of this paper, we refer to the former as popularity and to the latter as prestige. 

Similar considerations apply to the assessment of scholarly communication where citation counts are com- 
monly used as an indication of scholarly status. For example, a journal that publishes mostly review articles 
may be frequently cited by graduate students, yet largely be ignored by experts interested in the cutting edge of 
research. The Thomson ISI Impact Factor (ISI IF) is generally accepted as an indicator of journal status, and 
is defined as the mean number of citations to articles published in a journal over a 2 year period [10, 9]. Given 
that the ISI IF is based on the amount of citations to a journal, and does not take into account the prestige of 
the citing journals, it seems to only represent the popularity factor of status, not its prestige factor. 

Many concerns have been expressed over the usefulness of the ISI IF as an indicator of journal status 
[25, 11, 18, 16, 24, 1]. In fact, its focus on popularity would render it impossible to use in many other areas, 
such as for example the WWW. A web page that is often linked to can indeed be of very low status and vice 
versa. For that reason, alternatives to link counting, developed in the domain of social network analysis, have 
been widely adopted for WWW searching. 

When the Google search engine ranks web pages according to their status it does so by not merely count- 
ing the number of hyperlinks to a page. Google's PageRank algorithm [7] computes the status of a Web page 
based on a combination of the number of hyperlinks that point to the page and the status of the pages that the 
hyperlinks originate from. By taking into account both the popularity and the prestige factor of status, Google 
has been able to avoid assigning high ranks to popular but otherwise irrelevant Web pages. 

The success of the PageRank algorithm in the Google environment has led to PageRank becoming a stan- 
dard technique to assess the status of web resources. However, where the evaluation of journal status is con- 
cerned the ISI IF still rules supreme. This situation may not be sustainable. As an ever growing collection of 
scholarly materials becomes available on the Web, and hence becomes searchable through Google and Google 
Scholar, our perception of article status (and hence of journal status) will change as a result of the PageRank- 
driven manner by which Google lists its search results. In the future, PageRank, not the ISI IF, may very well 
start representing our perception of article and journal status. 

A change from the ISI IF to PageRank-based metrics for journal ranking would effectively signify a shift 
from an evaluation based on popularity, i.e. citation frequency, to an evaluation based on prestige, i.e. the pres- 
tige of those who cite is taken into account. To evaluate the consequences of such a change on the assessment 
of journal status, we used the dataset of the 2003 ISI Journal Citation Reports (ISI JCR) to compare the ISI IF 
and Weighted PageRank rankings of journals. We paid special attention to journals with a significant discrep- 
ancy between their ISI IF and Weighted PageRank values. We also introduce a ranking principle, the Y-factor, 
to rank journals according to whether they have both high ISI IF and Weighted PageRank values. 
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2 Two common metrics of status 

Citations are at the basis of most present attempts to assess scholarly impact. This is true for the assessment 
of the impact of individual articles, journals, researchers [8, 3, 12], research departments, universities and 
even countries [6, 5, 23, 13]. As articles cite one another, they define an article citation network in which 
each node represents an article and each directed edge represents a citation by that article to another. By 
grouping all articles published in the same journal under a single journal node, an article citation network can 
easily be transformed into a Journal Citation Network. In that network, the directed edges between the journal 
nodes represent the collection of citations from one journal to another. This network can be formalized as 
a set of journals V, a set of directed edges E C V 2 that exist between the journals in V, and the function 
W(vi,Vj) — > N + which maps each edge between the journal V{ and Vj to a positive, integer citation frequency. 
A range of journal status metrics can be applied to such a Journal Citation Network. In the following sections, 
we discuss two highly common metrics, namely the ISI Impact Factor and Google's PageRank. The latter has 
been modified to take into account edge weights (Weighted PageRank) so that it can be applied to the Journal 
Citation Network. 



2.1 The ISI Impact Factor 

The ISI IF defines the status of a journal for a specific year as the mean number of citations that occurred in that 
year to the articles published in the journal during the two previous years. More concretely, the 2003 ISI IF of 
a journal V{ is calculated by dividing the number of citations made in 2003 to Uj's 2001 and 2002 articles by the 
total number of articles Vi published in 2002 and 2001. Expressed in terms of a Journal Citation Network the 
ISI IF corresponds to a journal's in-degree [2] normalized by the total number of papers the journal published 
in that period. Eq. 1 defines the IF of journal Vi in year t, labeled IF(vi,t), as follows: 

V„- c(vj,Vi,t) 

IF{v u t) = ^ \" " ' (1) 
n(vi) 

where c(vj,Vi,t) corresponds to the number of citations from journal vj to journal Vi in year t. The num- 
ber of publications published in journal Vi, denoted n(vi), during the two years previous to t, normalizes the 
resulting citation count, leading to a mean, 2-year citation rate per article. 

In social network analysis terms, in-degree can be considered a metric of popularity because it corresponds 
to the number of endorsements received by a particular actor in the network. And, indeed, when assuming that 
a citation to a journal indicates an endorsement of the journal's content, we find that, in terms of social network 
analysis, the ISI IF is a measure of popularity because a journal has a higher ISI IF if its articles are more often 
cited. 



2.2 Journal PageRank 

This aspect of the ISI IF has been known and studied for decades. In particular, Pinski et al. (1977) [22] 
propose an algorithm that evaluates the influence of journals by taking into account not simply the number of 
citations from one journal to the other, but also the prestige of the citing journal. Journals that receive many ci- 
tations from prestigious journals are considered highly prestigious themselves. By iteratively passing prestige 
from one journal to the other, a stable solution is reached which reflects the relative prestige of journals. This 
procedure is highly related to efforts in social network science to define status in terms of "inherited" status, 
e.g. eigenvector centrality [4] , systems to separate web pages into "authoraties" and "hubs" [14, 15] and recent 
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investigations of the role of journals as knowledge sources or storers [19]. 

Within this long lineage of social network metrics of status, the founders of the Google search engine 
outline an algorithm to assess the prestige of web pages based on similar principles in their 1998 paper "The 
anatomy of a large-scale search engine" [7]. This concept is further developed in later publications [20] in terms 
of random walk models of web navigation. Much like the proposal by Pinski et al., PageRank is calculated 
by an iterative algorithm which propagates prestige values from one web page to another and converges to a 
solution [21]. The PageRank equation that governs the iterative transfer of PageRank values from one web 
page to the other is shown in Eq. 2: 



In Eq. 2, it is assumed that a collection of pages Vj link to a recipient page Vi and each transfers a proportion 
of their PageRank, denoted PR{vj), to Vi. It is also assumed that PageRank values are equally distributed 
along a page's out-links, i.e. if a page Vj has 3 out-links each recipient page Vi receives only one-third of 
Vj 's PageRank. Transfered PageRank values are therefore normalized by the number of out-links from page 
Vj which is denoted 0(vj). The parameter A, which can take values between zero and one, represents the 
attenuation of prestige values as they are transferred from one web page to the other. The parameter ^jp- 
represents the minimal amount of prestige assigned to each web page. N represents the total number of pages 
in the network. 

2.3 Weighted PageRank for Journal Citation Networks 

PageRank has become a standard to evaluate the status of web pages. It is our objective to apply it to Journal 
Citation Networks so that we can compare two highly common metric of status, i.e. the ISI IF and PageRank, 
in terms of their ability to evaluate the relative popularity or prestige of journals. The PageRank definition 
above assumes that prestige is distributed equally across all of a web page's hyperlinks. This is appropriate 
since hyperlinks are not weighted, i.e. each hyperlink indicates an equal degree of relationship between a pair 
of linked pages. In the Journal Citation Network, however, not all edges are created equal; some journals are 
connected by more citations than others. The PageRank equation when applied to journal citation networks 
should therefore be adapted to take into account journal citation frequencies in its transfer of PageRank values. 
Indeed, if a journal Vj cites journal Vi 10 times more frequently than any other journal, the amount of prestige 
transferred from Vj to vi should be ten times as high. More generally, a journal that receives many citations 
from a specific other journal should receive a matching proportion of that journal's prestige. 

This is in fact a common problem encountered in applications of PageRank to weighted networks. Mod- 
ifications of the PageRank equation have therefore been proposed to take into account link weights. A Web- 
based Weighted PageRank algorithm has earlier been defined [29] to calculate aggregate web site prestige and 
a weighted PageRank algorithm has been to used to rank authors in a weighted co-authorship network [17]. 
The notion of weighted link weights is in fact an integral part of Pinski and Narin's approach to define journal 
prestige. We will briefly discuss these common modifications of the PageRank equation in terms of weighted 
journal citation networks below. 




(2) 



Assume we need to rewrite Eq. 2 to account for the transmission of journal prestige relative to the number 
of citations that exist between pairs of journals in the Journal Citation Network. First, we define a propagation 
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proportion w(vj,Vi) between journals vi and Vj by normalizing the link weights emanating from a particular 
journal Vj as follows: 



w{ ,„ Vl) = ^p±- (3) 



For any particular journal Vj, all w(vi,Vj) now sum up to one and it can therefore be used to determine the 
fraction of a journal's PageRank it transfers to the journals it cites. 

We now obtain the Weighted PageRank equation for journal vj as follows: 

PR w {vi) = + A p Rw(vj) x w( Vj ,v t ) (4) 

3 

According to Eq. 4, the transfer of prestige from one journal to the other is modulated by the propagation 
proportion w(vj,Vi). In effect, the equal distribution of PageRank values in Eq. 2, as given by the factor 
qLa , has been replaced by the propagation proportion w(vj,v.i) thereby allowing Weighted PageRank to be 
calculated for Journal Citation Networks. 



2.4 Product of ISI IF and Weighted PageRank 

We now have two different, but highly common, metrics of status at our disposal. The ISI IF relies on citation 
frequencies and therefore stresses the popularity aspect of journal status. The Weighted PageRank, as denned 
above, relies on a propagation of prestige values from one journal to the other, and therefore corresponds better 
to our intuitive notion that prestige is not only a matter of the number of endorsements, but who is actually 
endorsing. 

Thus defined, the ISI IF and the Weighted PR represent highly common, but possibly different, facets of 
journal status. As will be demonstrated in section 3.2, there can indeed exist significant discrepancies between 
a journal's ISI IF and Weighted PageRank values, i.e. some journals can have high ISI IF and low Weighted 
PageRank values, and vice versa. To rank journals on the basis of both metrics combined we defined a product 
of the ISI IF and the Weighted PageRank, labeled y-factor, as shown in Eq. 5 below. 

Y(vj) = ISI IF(^) x PR w (vj) (5) 

Journals that score highly on the Y-factor will be ranked highly by either or both the ISI IF and Weighted 
PageRank. The resulting rankings are included in the following section for informational purposes. 



3 Indicators of Journal Status 

In this section, we compare three indicators of status in the Journal Citation Network: the popularity-oriented 
ISI IF, the prestige-oriented Weighted PageRank and a product of both, namely the Y-factor. We do so based 
on the dataset provided by the 2003 ISI Journal Citation Reports. 
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3.1 Comparing the ISI IF and the Weighted PageRank 

In order to obtain Weighted PageRank values for journals that have an ISI Impact Factor, a Journal Citation 
Network was constructed on the basis of the 2003 ISI JCR data set which contains 2003 journal citations to 
2001 and 2002 publications. This journal citation information was represented as a matrix in which both rows 
and columns represent journals, and in which cells represent the amount of times a journal in a row cites a 
journal in a column. Not surprisingly, a sparse matrix resulted, with 5710 journals having non-zero citation 
counts. 

To provide an indication of the overall characteristics of the ISI IF and the Weighted PageRank, Table 1 
shows the ten highest ranking journals for both status metrics. Clearly, the rankings diverge significantly, with 
only three journals, Nature, Science and The New England Journal of Medicine being represented in both 
lists. We observe that the journals with the highest ISI IF are strongly positioned in the area of medicine, with 
review journals being heavily represented. The latter confirms the characterization of the ISI IF as a popularity- 
oriented metric, since review journals typically publish background material that is likely to be cited frequently. 
Overall, the listing according to Weighted PageRank shows more variations in scholarly discipline, and many 
of the top-ranked journals such as Science, Nature, Cell and the Journal of Biological Chemistry are generally 
considered highly prestigious journals. 

A more quantitative analysis of the overlap and discrepancies between the two status metrics is provided 
by the scatter plot of Fig. 1. Despite the strong discrepancies in the top ten listings according to both sta- 
tus metrics, the plot reveals a significant overall correlation, confirmed by a Pearson correlation coefficient of 
r = 0.48, p < 0.01 between the ISI IF and the Weighted PageRank. We note that the journals Nature and 
Science are positioned in the top-right corner of the scatter plot, reflecting the fact that they have both high 
ISI IF and high Weighted PageRank values. This means that both journals are often cited and are cited by 
prestigious journals. 

Since it is common knowledge in bibliometrics that comparisons of ISI IF values across scholarly disci- 
plines are problematic due to differences in the publication and citation process, we decided to focus on a 
subset of our Journal Citation Network that pertains to Physics journals. We selected Physics journals in the 
2003 ISI JCR dataset on the basis of the ISI subject categories listed in Table 2. The resulting Physics subset 
of the Journal Citation Network contained 229 journals. A ranking of this subset according to ISI IF, Weighted 
PageRank and the Y-factor is shown in Table 5. 

We can detect a pattern similar to that found for the complete Journal Citation Network. Again, only 2 
journals, namely Physical Review Letters and Journal of High Energy Physics, are amongst the highest rank- 
ing according to both the ISI IF and the Weighted PageRank. In addition, the ISI IF rankings can again be 
characterized by a preponderance of applied physics journals that frequently publish background material that 
is likely to be cited. The Weighted PageRank ranking seems to focus on a set of journals typically appreciated 
by domain experts, as the journals of the American Physical Society: Physical Review A, D and E . The Pear- 
son correlation coefficient between ISI IF and Weighted PageRank values was found to be lower than was the 
case with the complete Journal Citation Network, namely r = 0.24, p < 0.01. This lower correlation indicates 
a lesser degree of intra-discipline overlap between both metrics. We leave the interpretation of the Y-factor 
rankings to the reader. 

Proceeding along the same lines, we also compared the ISI IF and the Weighted PageRank for journals 
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ISI IF PR W Y-factor 



rank 


value 


Journal 


value (x 10 3 ) 


Journal 


value(x 10^) 


Journal 


1 


52.28 


ANNU REV IMMUNOL 


16.78 


NATURE 


51.97 


NATURE 


2 


37.65 


ANNU REV BIOCHEM 


16.39 


J BIOL CHEM 


48.78 


SCIENCE 


3 


36.83 


PHYSIOL REV 


16.38 


SCIENCE 


19.84 


NEW ENGL J MED 


4 


35.04 


NAT REV MOL CELL BIO 


14.49 


PNAS 


15.34 


CELL 


5 


34.83 


NEW ENGL J MED 


8.41 


PHYS REV LETT 


14.88 


PNAS 


6 


30.98 


NATURE 


5.76 


CELL 


10.62 


J BIOL CHEM 


7 


30.55 


NAT MED 


5.70 


NEW ENGL J MED 


8.49 


JAMA 


8 


29.78 


SCIENCE 


4.67 


J AM CHEM SOC 


7.78 


LANCET 


9 


28.18 


NAT IMMUNOL 


4.46 


J IMMUNOL 


7.56 


NAT GENET 


10 


28.17 


REV MOD PHYS 


4.28 


APPL PHYS LETT 


6.53 


NAT MED 



Table 1 : The highest ranking journals according to ISI IF, Weighted PageRank and Y-factor 



ISI Category ISI Category Name 



UB 


PHYSICS, APPLIED 


UF 


PHYSICS, FLUIDS & PLASMAS 


UH 


PHYSICS, ATOMIC, MOLECULAR & CHEMICAL 


UI 


PHYSICS, MULTIDISCIPLINARY 


UK 


PHYSICS, CONDENSED MATTER 


UN 


PHYSICS, NUCLEAR 


UP 


PHYSICS, PARTICLES & FIELDS 


UR 


PHYSICS, MATHEMATICAL 



Table 2: ISI Subject Categories for Physics Journals. 



ISI Category ISI Category Name 



EP COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE 

ER COMPUTER SCIENCE, CYBERNETICS 

ES COMPUTER SCIENCE, HARDWARE & ARCHITECTURE 

ET COMPUTER SCIENCE, INFORMATION SYSTEMS 

EV COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS 

EW COMPUTER SCIENCE, SOFTWARE, GRAPHICS, PROGRAMMING 

EX COMPUTER SCIENCE, THEORY & METHODS 



Table 3: ISI Subject Categories for Computer Science Journals. 
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Figure 1: Scatter plot of the ISI IF versus the Weighted PageRank (PRw). 



ISI Category 


ISI Category Name 


DS 


CRITICAL CARE MEDICINE 


FF 


EMERGENCY MEDICINE 


FY 


DENTISTRY ORAL SURGERY & MEDICINE 


OI 


INTEGRATIVE & COMPLEMENTARY MEDICINE 


OP 


MEDICINE, LEGAL 


PY 


MEDICINE, GENERAL & INTERNAL 


QA 


MEDICINE, RESEARCH & EXPERIMENTAL 


VY 


RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING 


YU 


TROPICAL MEDICINE 



Table 4: ISI Subject Categories for Medicine Journals. 
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in Computer Science and Medicine. Again, subsets of the Journal Citation Network were extracted by means 
of ISI category codes; Table 3 and Table 4 list these codes for Computer Science and Medicine, respectively. 
The results for Computer Science reveal an even greater discrepancy between the ISI IF and the Weighted 
PageRank. Indeed, as can be seen in Table 6, only the journal Bioinformatics ranks in the top ten according to 
both the ISI IF and the Weighted PageRank. Again, it seems that many of the top-ranking journals according 
to the Weighted PageRank specialize in a focused research area. The scatterplot in Fig. 3 further confirms the 
greater divergence between the ISI IF and the Weighted PageRank values. The Pearson correlation coefficient 
was found to be r = 0.5, p < 0.01. The Medicine subset of the Journal Citation Network follows a different 
pattern than that of the Physics and Computer Science subsets. As can be seen in Table 7, 9 journals appear 
in the top ten according to both the ISI IF and the Weighted PageRank. And, the scatterplot in Fig. 4 further 
confirms the higher degree of overlap between the two metrics in Medicine. Indeed, the Pearson correlation 
coefficient between the ISI IF and the Weighted PageRank values was found to be r = 0.91, p < 0.01, 
indicating that the notions of prestige and popularity are more strongly intertwined for Medicine than they are 
for the other explored domains. Overall, it seems that the level of discrepancy between the ISI IF and the 
Weighted PageRank across disciplines relates to variations in the characteristics of the publication and citation 
practices in different domains. 

3.2 Popular and Prestigious Journals 

Intrigued by the significant correlation between the ISI IF and the Weighted PageRank as shown in Fig. 1 and 
the significant discrepancies revealed in Table 1 and Table 5, we set out to inspect the Journal Citation Network 
for journals that have strongly diverging ISI IF and Weighted PageRank values. Two types of divergences were 
explored: 

Popular Journals are journals that are cited frequently by journals with little prestige. These journals have a 
very high ISI IF and a very low Weighted PageRank. 

Prestigious Journals are journals that are not frequently cited, but their citations come from highly prestigious 
journals. These journals have a very low ISI IF and a very high Weighted PageRank. 

We identified Popular and Prestigious Journals in the full Journal Citation Network, but were unable to 
recognize a meaningful pattern in the results. This was not unexpected as the exercise amounted to comparing 
ISI IF values across disciplines. Hence, we decided to refocus our attention on the Physics subset of the Journal 
Citation Network. We empirically decided on threshold values for the ISI IF and the Weighted PageRank that 
guaranteed a sufficient number of journals in both the Popular and Prestigious category. First, we decided that 
any Weighted PageRank value below the 40th percentile was very low, and any value above the 90th percentile 
was very high. These choices are represented by the vertical lines in the scatter plot of Fig. 2. Second, to 
determine the low and high threshold values for the ISI IF, we generated a linear regression model for the 
relationship between the ISI IF and the Weighted PageRank. The result is visualized in Fig. 2 as the line that 
cuts across the cloud of physics journals. Figure 2 outlines the regions of the scatter plot that correspond to our 
categorization of Popular and Prestigious Journals and to our chosen threshold values. The former category 
is shown as the top-left region, the latter as the bottom-right region. Popular, prestigious and high Y-factor 
ranking journals are labeled by their abbreviated journal titles in the graph. Table 8 shows the ten top-ranked 
journals in both the Popular and Prestigious Journals category ranked by the degree to which their actual ISI 
IF deviates from the value predicted by the linear regression model, labeled IF a- 

A close examination of the resulting Popular Journal category reveals that it contains either review journals 
or journals that frequently publish data tables. Such journals are likely to be cited as background material, 
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rank 


IF 


Title 


PR W x 10 3 


Title 


Y x 10 2 


Title 


1 


28.17 


REV MOD PHYS 


8.41 


PHYS REV LETT 


5.91 


PHYS REV LETT 


2 


13.09 


ADV PHYS 


4.28 


APPL PHYS LETT 


1.73 


APPL PHYS LETT 


3 


11.98 


PHYS REP 


2.59 


J APPL PHYS 


1.50 


REV MOD PHYS 


4 


10.03 


MAT SCI ENG R 


2.38 


PHYS REV D 


1.09 


PHYS REV D 


5 


8.67 


ANNU REV NUCL PART S 


2.34 


PHYS REV E 


0.69 


J CHEM PHYS 


6 


8.41 


REP PROG PHYS 


2.32 


J CHEM PHYS 


0.66 


J HIGH ENERGY PHYS 


7 


7.04 


PHYS REV LETT 


1.56 


PHYS LETT B 


0.63 


PHYS LETT B 


8 


7.00 


SOLID STATE PHYS 


1.55 


PHYS REV A 


0.57 


NUCL PHYS B 


9 


6.06 


J HIGH ENERGY PHYS 


1.22 


CHEM PHYS LETT 


0.56 


J APPL PHYS 


10 


5.97 


PROG NUCL MAG RES SP 


1.09 


J HIGH ENERGY PHYS 


0.56 


PHYS REP 



Table 5: The highest ranking Physics journals according to ISI IF, Weighted PageRank (PRw) and Y-factor. 



rank 


IF 


Title 


PR W x 10 4 


Title 


Y x 10 4 


Title 


1 


7.50 


ACM COMPUT SURV 


10.08 


IEEE T INFORM THEORY 


62.27 


BIOINFORMATICS 


2 


6.70 


BIOINFORMATICS 


9.29 


BIOINFORMATICS 


22.64 


IEEE T INFORM THEORY 


3 


4.54 


VLDB J 


5.90 


COMPUT METHOD APPL M 


21.68 


IEEE T PATTERN ANAL 


4 


3.87 


IEEE NETWORK 


5.67 


IEEE T PATTERN ANAL 


12.11 


ACM COMPUT SURV 


5 


3.82 


IEEE T PATTERN ANAL 


5.48 


J COMPUT PHYS 


11.78 


IEEE T IMAGE PROCESS 


6 


3.76 


IEEE T MED IMAGING 


4.98 


COMMUN ACM 


11.47 


IEEE T MED IMAGING 


7 


3.73 


IEEE INTELL SYST APP 


4.95 


THEOR COMPUT SCI 


10.37 


J ACM 


8 


3.61 


IBM J RES DEV 


4.46 


IEEE T IMAGE PROCESS 


9.65 


J COMPUT PHYS 


9 


3.33 


INFORM SYST 


4.35 


COMPUTER 


8.59 


IEEE INTELL SYST APP 


10 


3.32 


J ACM 


3.36 


IEEE T NEURAL NETWOR 


8.20 


ARTIF INTEL 



Table 6: The highest ranking Computer Science journals according to ISI IF, Weighted PageRank (PRw) and 
Y-factor. 



rank 


IF 


Title 


PR W x 10 3 


Title 


Y x 10 2 


Title 


1 


34.83 


NEW ENGL J MED 


5.70 


NEW ENGL J MED 


19.84 


NEW ENGL J MED 


2 


30.55 


NAT MED 


4.25 


LANCET 


8.49 


JAMA 


3 


21.46 


JAMA 


3.96 


JAMA 


7.78 


LANCET 


4 


18.32 


LANCET 


2.27 


J CLIN INVEST 


6.53 


NAT MED 


5 


15.30 


J EXP MED 


2.23 


J EXP MED 


3.42 


J EXP MED 


6 


14.31 


J CLIN INVEST 


2.14 


NAT MED 


3.25 


J CLIN INVEST 


7 


12.42 


ANN INTERN MED 


1.40 


AM J RESP CRIT CARE 


1.44 


ANN INTERN MED 


8 


11.38 


ANNU REV MED 


1.16 


ANN INTERN MED 


1.24 


AM J RESP CRIT CARE 


9 


8.88 


AM J RESP CRIT CARE 


0.91 


NEUROIMAGE 


0.59 


ARCH INTERN MED 


10 


6.76 


ARCH INTERN MED 


0.87 


ARCH INTERN MED 


0.57 


NEUROIMAGE 



Table 7: The highest ranking Medicine journals according to ISI IF, Weighted PageRank (PRw) and Y-factor. 
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hence have a high ISI IF, but they do not correspond well to what would generally be perceived as a prestigious 
journal. The Prestigious Journal category reveals a collection of highly esteemed Physics journals: Journal of 
Applied Physics, Physical Review E, and Journal of Chemical Physics to name a few. Despite their prestigious 
status, they have an unexpectedly low ISI IF. 

Again, a similar analysis was performed for the Computer Science and Medicine subsets of the Journal 
Citation Network. The Popular journals for Computer Science listed in Table 9 and shown in Fig. 3 contains a 
number of methodological journals such as Science of Computer Programming and Formal Methods in System 
Design which may be frequently cited as background material. It is striking, however, to find that the journal 
Artificial Life comes out as the most Popular one; this journal is often cited but not classified as Prestigious. At 
the opposite end of the spectrum is the journal IEEE Transactions on Information Theory which is classified as 
Prestigious, indicating that it is appreciated by domain experts, but it lags in citation counts. When comparing 
the Popular and Prestigious Medicine journals, shown in Table 10 and Fig. 4, the most striking position is 
held by Lancet which is assigned to the set of Prestigious journals but whose IF is significantly lower than 
expected. Since we had already found that the ISI IF and the Weighted PageRank are most strongly correlated 
for Medicine, we are not surprised to not find a particularly salient pattern when comparing its Popular and 
Prestigious sets of journals. 



4 Conclusion 

The distinction between popularity and prestige that is prevalent in all areas of social life has yet to find its way 
into the assessment of scholarship. There, the ISI Impact Factor rules as the prime indicator or journal status. 
The ISI IF for a given journal is based on the number of citations it receives, and ignores the prestige of the 
citing journals. Therefore, it is an indicator of journal status that favors popularity over prestige. 

In this paper, we have added new insights to the ongoing discussions regarding the suitability of the ISI 
IF as the sole metric of journal status. The outcome of what is becoming a global discussion can have a fun- 
damental impact on scholarly communication and assessment [28], as the ISI IF metric also lies at the basis 
of the assessment of the status of scholars, research departments, universities and countries. In this paper, we 
found that, while the journal status metric that we obtained by computing Weighted PageRank for all journals 
in a Journal Citation Network strongly overlapped with the ISI IF, it also revealed significant and meaningful 
discrepancies. PageRank is a metric known to take the prestige factor of status into account. It has provided 
the foundation for a revolution in Web searching, and it has since successfully been applied to obtain rankings 
of nodes in a wide variety of networks. We find the mere fact that the widely used PageRank metric differs in 
a meaningful manner from the ISI IF a reason to seriously contemplate the use of a variety of journal status 
metrics instead of just one. Whether or not a PageRank inspired metric will be added to the status assessment 
arsenal, it will de facto change our perception of status as it will be the manner in which scholarly search results 
will be ranked by Google, Google Scholar and its competitors [26, 27]. 

To further underline, as many of our colleagues have done before us, that the ISI IF is not the Oracle, but 
just one of many possible measures of status, we have introduced a ranking of journals according to a product 
of the ISI IF and the Weighted PageRank. The intuitive and simplistic definition of the Y-factor rankings may 
not be scientifically convincing, still the authors were more than slightly intrigued to find that the top scoring 
journals according to this ranking principle rather closely matched their personal perception of importance. 
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rri Y o Kil V Lrl 1 1 


/.U4 


8.41 
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z 




/ .UU 


J.OJ 


J.40 


J APPL PHYS 


2.17 


Z.jy 


1 


3 


PROG NUCL MAG RES SP 


5.97 


6.53 


4.41 


PHYS REV E 


2.20 


2.34 


-1.27 


4 


ATOM DATA NUCL DATA 


4.63 


5.94 


3.08 


APPL PHYS LETT 


4.05 


4.28 


-1.05 


5 


CRIT REV SOLID STATE 


4.44 


3.11 


2.91 


JPN J APPL PHYS 


1.17 


0.83 


-1.03 


6 


ADV ATOM MOL OPT PHY 


4.11 


6.16 


2.55 


NUCL INSTRUM METH A 


1.17 


0.57 


-0.81 


7 


PROG SURF SCI 


3.74 


6.31 


2.19 


J PHYS A-MATH GEN 


1.36 


0.61 


-0.65 


8 


CHEM VAPOR DEPOS 


2.07 


5.29 


0.52 


J PHYS CONDENS MAT 


1.76 


0.93 


-0.52 


9 


RIV NUOVO CIMENTO 


1.70 


3.21 


0.17 


J CHEM PHYS 


2.95 


2.32 


-0.50 


10 


J NONLINEAR SCI 


1.62 


6.10 


0.06 


PHYS FLUIDS 


1.57 


0.62 


-0.45 



Table 8: The top-ranked Popular and Prestigious journals in Physics. 
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Figure 2: Popular and Prestigious Journals in Physics. 
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Figure 3: Popular and Prestigious Journals in Computer Science. 
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Prestigious: ISI IF |, PR„, > 90%-tile 
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PR W x 10 b 


IF A 


Journal title 
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PR„, x 10 4 


IF A 


1 


ARTIF LIFE 


3.17 


4.76 


2.34 


IEEE T INFORM THEORY 


2.25 


10.08 


-2.36 


2 


INT J HIGH PERFORM C 


2.31 


5.76 


1.44 


THEOR COMPUT SCI 


0.76 


4.95 


-1.82 


3 


NETWORK-COMP NEURAL 


2.21 


5.82 


1.34 


COMPUT METHOD APPL M 


1.25 


5.90 


-1.71 


4 


J MOL MODEL 


2.14 


5.53 


1.28 


FUZZY SET SYST 


0.58 


2.92 


-1.21 


5 


ACM T PROGR LANG SYS 


1.68 


5.18 


0.83 


COMPUT STRUCT 


0.63 


2.81 


-1.11 


6 


FORM METHOD SYST DES 


1.46 


3.91 


0.66 


COMMUN ACM 


1.55 


4.98 


-1.05 


7 


METHOD INFORM MED 


1.42 


6.29 


0.53 


J COMPUT PHYS 


1.76 


5.48 


-1.03 


8 


IEEE MULTIMEDIA 


1.15 


6.23 


0.26 


COMPUTER 


1.55 


4.35 


-0.80 


9 


NEW GENERAT COMPUT 


1.03 


4.11 


0.23 


MATH PROGRAM 


1.29 


3.10 


-0.57 


10 


SCI COMPUT PROGRAM 


1.06 


5.39 


0.21 


PATTERN RECOGN 


1.61 


3.33 


-0.34 



Table 9: The top-ranked Popular and Prestigious journals in Computer Science. 
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Figure 4: Popular and Prestigious Journals in Medicine. 
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IF A 


1 


CURR MED RES OPIN 


2.73 


5.55 


1.29 


LANCET 


18.32 


4.25 


-7.76 


2 


J ENDOTOXIN RES 


2.51 


5.70 


1.06 


JAMA 


21.46 


3.96 


-2.93 


3 


DIS MARKERS 


2.38 


4.06 


1.03 


AM J ROENTGENOL 


2.47 


0.53 


-1.74 


4 


ANTISENSE NUCLEIC A 


2.41 


5.15 


0.99 


RADIOLOGY 


4.82 


0.86 


-1.36 


5 


J BIOMED SCI 


1.94 


5.46 


0.50 


VACCINE 


3.01 


0.51 


-1.10 


6 


BRAIN TOPOGR 


1.82 


4.67 


0.43 


INT J RADIAT ONCOL 


4.29 


0.67 


-0.75 


7 


CANCER BIOTHER RADIO 


1.84 


5.26 


0.42 


AM J RESP CRIT CARE 


8.88 


1.40 


-0.46 


8 


INT J HYPERTHER 


1.76 


4.10 


0.41 


CRIT CARE MED 


4.20 


0.58 


-0.36 


9 


J RADIAT RES 


1.70 


4.01 


0.35 


MAGNET RESON MED 


3.31 


0.43 


-0.31 


10 


ULTRASONIC IMAGING 


1.58 


3.67 


0.25 


NEUROIMAGE 


6.19 


0.91 


-0.29 



Table 10: The top-ranked Popular and Prestigious journals in Medicine. 
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